GROBNER GEOMETRY OF VERTEX DECOMPOSITIONS 
AND OF FLAGGED TABLEAUX 

ALLEN KNUTSON, EZRA MILLER, AND ALEXANDER YONG 

Abstract. We relate a classic algebro-geometric degeneration technique, dating 
at least to [Hodge 1941], to the notion of vertex decompositions of simplicial com- 
plexes. The good case is when the degeneration is reduced, and we call this a 
geometric vertex decomposition. 

Our main example in this paper is the family of vexillary matrix Schubert vari- 
eties, whose ideals are also known as (one-sided) ladder determinantal ideals. Us- 
ing a diagonal term order to specify the (Grobner) degeneration, we show that 
these have geometric vertex decompositions into simpler varieties of the same 
type. From this, together with the combinatorics of the pipe dreams of [Fomin- 
Kirillov 1996], we derive a new formula for the numerators of their multigraded 
Hilbert series, the double Grothendieck polynomials, in terms of flagged set-valued 
tableaux. This unifies work of [Wachs 1985] on flagged tableaux, and [Buch 2002] 
on set-valued tableaux, giving geometric meaning to both. 

This work focuses on diagonal term orders, giving results complementary to 
those of [Knutson-Miller 2005], where it was shown that the generating minors 
form a Grobner basis for any awhdiagonal term order and any matrix Schubert va- 
riety. We show here that under a diagonal term order, the only matrix Schubert 
varieties for which these minors form Grobner bases are the vexillary ones, reach- 
ing an end toward which the ladder determinantal literature had been building. 
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1. Introduction and statement of results 



Fix an ideal I in a polynomial ring, or correspondingly, its zero scheme X in- 
side a coordinatized vector space. Each term order yields a Grobner basis for I, 
or geometrically, a Grobner degeneration of X into a possibly nonreduced union 
of coordinate subspaces. Such a degeneration often creates too many pieces all at 
once, or spoils geometric properties like reducedness; it can be better to work in- 
stead with less drastic degenerations that take the limit of X under rescaling just 
one axis at a time. The limit X' breaks into two collections of pieces: a projection 
part and a cone part. In cases where X' is reduced, quantitative information such as 
multidegrees and Hilbert series of the original variety X can be derived separately 
from the parts of this geometric vertex decomposition of X and combined later. Re- 
ducing the computation of invariants of X to those of X' can be especially helpful 
when the projection and cone parts of X' are simpler than X. 

Under suitable hypotheses, repeating the degeneration-decomposition proce- 
dure for each coordinate axis in turn eventually yields the Grobner degeneration, 
but with extra inductive information. When the limit X" of this sequence is a union 
of coordinate subspaces, or equivalently, X" is defined by a squarefree monomial 
ideal, the inductive procedure corresponds exactly to the usual notion of vertex 
decomposition for simplical complexes, as defined in |BPJ. 

Our goals in this paper are to introduce and develop foundations of geometric 
vertex decompositions, to apply these generalities to the class of vexillary matrix 
Schubert varieties, and to exhibit the resulting combinatorics on their Grobner de- 
generations for diagonal term orders. In particular, through the notion of flagged 
set-valued tableaux, we unify the work of Wachs on flagged tableaux |Wac| and 
Buch on set-valued tableaux |Buc[, giving geometric meaning to both. Moreover, 
using these tableaux, we obtain new formulae for homological invariants of the 
vexillary matrix Schubert varieties. Our results can be interpreted as providing a 
complete, general, combinatorially enriched development of the theory surround- 
ing Grobner bases for the extensively studied ladder determinantal ideals, which are 
the defining ideals of vexillary matrix Schubert varieties. 

We begin in this section with a more precise overview, including statements of 
our main theorems. 

1.1. Vertex decompositions of simplicial complexes. Let A be a simplicial com- 
plex, and I a vertex of A. Define two subcomplexes of A: the deletion of 1 is the 
union 6 of faces of A not containing I, and the star of I is the union cr of the closed 
faces containing I. Then A equals the union of 6 and cr along the link A = 6 PI cr of I. 
The expression A = 6UAcrofAasa union of the deletion and star of 1 glued along 
the link is called the vertex decomposition of the complex A at the vertex I. Note 
that cr is a cone, namely the cone on A with cone point I. 

Vertex decompositions allow for inductive calculations on simplicial complexes, 
deriving good properties of A from corresponding properties of 6 and A. One such 
property is shellability, as first related to vertex decompositions in [BPJ. 

1.2. An analogue for affine schemes. Associated to a simplicial complex A with 
vertex set V is the Stanley-Reisner scheme Spec Ik [A], a reduced scheme in the 
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vector space A v over k with basis V defined by 

Spec k[A] = |J A F , 
FeA 

where A F is the coordinate subspace of A v with basis F. Starting from this per- 
spective, the notion of vertex decomposition extends to any coordinatized affine 
scheme X, meaning a subscheme of the vector space H x L where L is a line with 
coordinate y. As X might be irreducible, part of the extension involves breaking X 
into pieces by degeneration. 

On the vector space H x L we have an action of the algebraic torus k x = k \ {0} by 
scaling the L coordinate: t • (x, y) = [x, ty ). Consider the flat limit X' = lim t ^o t • X, 
which is the result of a sort of gradual projection of X to H. 

That X' contains the closure TT of the actual projection of X to H is obvious; but 
there is usually more in X'. View L as the finite part of L U {00} = P 1 , so H x L C 
H x P 1 , and we may take the closure X of X inside H x P 1 . As we slow-motion 
project X to H x {0} by scaling the L coordinate, we pull it away from Hqo = H x {00} 
without changing the intersection A = X fl H^. Consequently, the limit X' must 
contain the cone A x L from the origin over A. 

X' D (TT x {0}) U Ax{0} (A x L) 

By part of our first geometric result, Theorem l2.21 this lower bound correctly cal- 
culates X' as a set. When X' and this union are equal as schemes and not just as sets, 
such as when the ideal I(X') is radical and hence the intersection P n C of radical 
ideals P = I (IT) and C = I( A x L), we call this the geometric vertex decomposition 
of X along the splitting H © L. The letter P here stands for "projection", while C 
stands for "cone". 

Example 1.1. Let I = (xy — 1), so X is a hyperbola. Its projection to the x-axis is 
dense, and its intersection with the line at infinity meeting the y-axis occurs at 00 
on the y-axis itself. Hence we expect the limit X' to contain the x-axis and the y- 
axis. Calculating the limit using the k x action t ■ I = (xy — t), we set t = to get 
the ideal of X', namely I' = (xy). The equality I' = P fl C holds here, as P = (y) 
and C = (x), so this example is a geometric vertex decomposition of the hyperbola. 
The ideal I' is Stanley-Reisner, but fairly dull — the simplicial complex consists of 
two points. 

Example 1.2. Let I = (xy — 1) n (x,y), so X is now a hyperbola union a point at 
the origin. A Grobner basis for I under either of the lexicographic term orders is 
given by {y 2 x — y ,yx 2 — x}. Thus I' = (y 2 x,yx 2 ). As P = (y) and C = (x), we get 
I' 7^ C fl P = (xy ), so we do not have a geometric vertex decomposition in this case; 
the limit X' contains more, scheme-theoretically, than just the union of two lines. 
Note that even though P, C are radical ideals, I' is not radical. 

Example 1.3. Let A be a simplicial complex and X = Spec k[A] be the associated 
Stanley-Reisner scheme. Let L be the line corresponding to a vertex I and H be the 
hyperplane defined by the sum of the other coordinates. Then the limiting process 
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does not change X, i.e., X' = X, and the geometric vertex decomposition 

X' = (TT x {0}) U Ax{0} (A x L) 

is obtained by applying the Stanley-Reisner recipe to each of the subcomplexes of 
the vertex decomposition 

A = 6 U A ff. 

The algebro-geometric degeneration technique investigated here is classical, see, 
e.g., | Hod | . However, our desire to explicate the analogy with vertex decomposi- 
tions of simplicial complexes, and to put this story inside a general framework, 
was motivated by our work with vexillary matrix Schubert varieties, as detailed 
below. Actually, during the preparation of this text, further examples of geomet- 
ric vertex decompositions and applications of the methods given below have been 
found, see, e.g., llK7TllKY2llK2llKMNl|^JllPSl (see also O for a summary of the 
first four of these papers). We believe that it would be very interesting to find more 
examples of schemes that can be profitably studied from the viewpoint suggested 
here. 

1.3. Vexillary matrix Schubert varieties. To each permutation n e S n , there is an 
associated matrix Schubert variety X n C M n living in the space M n of n x n matrices, 
and also a set of accessible boxes in the diagram of n (these definitions appear in 
Sections I3.1H3.2I) . Each accessible box (I, m) yields a splitting M n = H © L, where 
H consists of the matrices with entry at (I, m), and L consists of those matrices 
with entries everywhere else. 

We are now ready to attempt a geometric vertex decomposition of X^. Things 
behave particularly well if n is vexillary, a condition with surprisingly many equiv- 
alent formulations, some of which are expounded in Section lS"^! 1 Among the vexil- 
lary permutations, the simplest (and easiest to characterize) are the Grassmannian 
permutations, which are those with exactly one descent 7t(i) > 7t(i + 1 ). The fol- 
lowing is stated more precisely in Lemma |3~71 Theorem 13.81 and Proposition 13.91 

Theorem. Fix a vexillary permutation n. 

a) Let M n = H © L be the decomposition at an accessible box. Set X' = lim t _> t • X^. 
Then X has a geometric vertex decomposition given by X' = (TT x {0}) U Ax {0} ( A x L), 
where TT x L and A x L are each again vexillary matrix Schubert varieties. 

b) There is a sequence of permutations en, . . . , cr t with en being Grassmannian and 
cr t = n, such that each X ffl for i > 1 arises as the cone part of a geometric vertex 
decomposition of the previous X^, . 

One interpretation of these two statements is that, if we wish to inductively 
study Grassmannian matrix Schubert varieties via our degeneration technique, 
then the class of vexillary matrix Schubert varieties is a suitable one to work in. An- 
other interpretation is that if we wish to answer questions about vexillary matrix 
Schubert varieties, then we should try to reduce these to questions about Grass- 
mannian matrix Schubert varieties. 



1 See |KY2| for a treatment of the non-vexillary case. 
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1.4. Grobner bases. The ideal l n of any matrix Schubert variety is generated 
by certain minors in the n x n matrix of variables, namely Fulton's essential mi- 
nors WFull . In this paper we are concerned with diagonal term orders, which by 
definition choose from each minor its diagonal term as the largest. The following 
combines Theorem B.BI and Theorem |6T] into one statement. 

Theorem. Let nbe a permutation. The essential minors constitute a Grobner basis for X n 
under some (and hence any) diagonal term order if and only if it is vexillary. 

The commutative algebra literature has been for some time sneaking up on the 
"if" direction of this result: extensively studied classes of increasingly complex lad- 
der determinantal ideals defined over the past decade are special cases of vexillary 
Schubert determinantal ideals; see, e.g., |KM1, Section 2.4] HStuUFuU lGMI and the 
references therein. The most inclusive class of ladder determinantal ideals whose 
generating minors have been shown previously to form diagonal Grobner bases 
appear in |GM | (which also contains a well- written exposition about past develop- 
ments) and cover a substantial portion of the vexillary cases. 

The "only if" direction is striking because the essential minors in 1^ form a 
Grobner basis for any antidiagonal term order, even if the permutation n is not 
vexillary |KM1[. Hence we push the diagonal term orders as far as they can go. 
The key point is that a permutation fails to be vexillary precisely when two of its 
essential rank conditions are nested, causing the diagonal terms of some essential 
minors to divide the diagonal terms of other (larger) essential minors. 

1.5. Flagged set-valued tableaux. As promised earlier, the initial scheme that is 
produced in Section IT~4l by Grobner-degenerating the matrix Schubert variety 
all at once exhibits inductive combinatorial structures inherited from stepwise geo- 
metric vertex decompositions. 

In |KM1 [, the antidiagonal initial schemes of all matrix Schubert varieties were 
shown to be Stanley-Reisner schemes of certain subword complexes (whose defini- 
tion from |KM2 [ we recall in Sectional in a special case). The faces of the subword 
complexes in |KM1| corresponded naturally to the reduced pipe dreams of Fomin 
and Kirillov IFK21IEE11 . 

Here, we again get subword complexes for the initial scheme, along with a geo- 
metric explanation for their vertex-decomposability However, the combinatorics 
involves flagged set-valued tableaux, whose definition we introduce in Sectional pro- 
viding the natural common generalization of flagged tableaux |Wac| and set-valued 
tableaux |Buc|. 2 For the term order, pick a total ordering of the n 2 matrix variables 
in which no variable appears earlier in the order than another one weakly to the 
southeast; the resulting lexicographic term order is easily seen to be a diagonal 
term order. The following theorem provides our Grobner geometry explanation of 
the naturality of flagged set-valued tableaux. 

Theorem. If n is a vexillary permutation, then the above lex ordering induces a sequence 
of degenerations ofX n , each one a geometric vertex decomposition. The end result of these 

2 An alternative combinatorial approach to this simplicial complex structure on tableaux, logi- 
cally independent of |KM2|, is given in |KMY|. 
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degenerations is a vertex decomposition of the initial scheme, the Stanley-Reisner scheme of 
a certain subzvord complex whose interior faces correspond in a natural way to flagged 
set-valued tableaux and whose maximal faces correspond to flagged tableaux. 

The first sentence of the above result was discussed in Section 11.31 To relate a 
geometric vertex decomposition along the way to an actual vertex decomposition 
at the end of the sequence we use Proposition 12.31 The rest is a combination of 
Theorem 14.41 where we identify the initial ideal, and Theorem 15.81 where we bi- 
ject the flagged set-valued tableaux with special cases of combinatorial diagrams 
called pipe dreams. When the permutation n is Grassmannian, the interior faces 
correspond bijectively to the set-valued tableaux — with no flagging — for the asso- 
ciated partition (Theorem l5.5l) , and the facets correspond to the usual semistandard 
Young tableaux (Proposition 15.3ft . The subword combinatorics of diagonal initial 
ideals is new even for the ladder determinantal ideals whose Grobner bases were 
already known from |GMJ . 

1.6. Schubert and Grothendieck polynomials. The combinatorics of initial ideals 
yields formulae for homological invariants. 

Geometrically, the space M n of n x n matrices carries two actions of the group T 
of invertible diagonal matrices, by multiplication on the left and inverse multi- 
plication on the right, each preserving every decomposition H © L along a matrix 
entry. The resulting Grobner degenerations are therefore T x T-equivariant, so they 
preserve the T x T-equivariant classes of in both cohomology and K-theory. 

Equivalently (and more algebraically), the coordinate ring of carries a grad- 
ing by Z 2n in which the variable Zy has ordinary weight x— Uj. Under this grading, 
the variety X^ has the same Z 2n -graded if -polynomial and multidegree (see |MS , 
Chapter 8] for definitions) as the Stanley-Reisner initial scheme from Section IT31 
Moreover, this ^ -polynomial and multidegree are known |KM1|: they are, respec- 
tively, the double Grothendieck polynomial and double Schubert polynomial associated 
by Lascoux and Schiitzenberger |LS| to n; see Section 15^21 for our conventions on 
Schubert and Grothendieck polynomials in this paper. The previous theorem im- 
plies the following. 

Corollary. Let n G S n be a vexillary permutation. The double Schubert polynomial can 
be expressed as the positive sum 



over the set FT{n) of flagged tableaux associated to n, all of which have shape ~k{n). Each 
product is over the entries e of x, whose numerical values are denoted val(e), and where 
j(e) = c[e) — r(e) is the difference of the row and column indices. 

The double Grothendieck polynomial Gnl*-, y ) can be expressed as the sum 



over the set FSVT{n) of flagged set-valued tableaux associated to n. The sign {— 1 ) |t| |a| 
alternates with the number of "excess" entries in the set-valued tableau. 
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This result appears as part of Theorem 15.81 It was already known in the case of 
single Schubert polynomials HWacI and in the case of Grothendieck polynomials 
for Grassmannian permutations |Buc|- 

Since the paper |KM1[ already provided a geometric explanation for a combi- 
natorial formula for the Grothendieck and Schubert polynomials of any vexillary 
permutation — indeed, of any permutation — the reader may wonder why we have 
provided another one. There are three reasons. The primary reason is to show 
that the combinatorial trick we used in |KM2|, vertex-decomposability, can have a 
transparent geometric origin. Another is to directly connect the Grobner geometry 
to Young tableaux, rather than to the less familiar pipe dreams. Finally, the two 
formulae themselves are very different, as demonstrated in Example l5.10l 

One of the satisfying aspects of the degenerations in this paper is that they stay 
within the class of (vexillary) matrix Schubert varieties. While one can view the 
antidiagonal degeneration used in |KM1 [ also in terms of geometric vertex decom- 
positions, we don't know what the cone and projection pieces look like along the 
way; they are no longer matrix Schubert varieties. 

2. Geometric vertex decompositions 

The main results on geometric vertex decompositions are most easily stated in 
algebraic language, so we do this first, in Theorem [ZlJ Then, for ease of future ref- 
erence, we make explicit in Section l2~2l the geometric interpretation of Theorem l2.il 
Our choice of geometric language makes it clear that the description of geometric 
vertex decomposition already given in Section 11.21 does not really depend on the 
hyperplane H. We close Section l2~2l with a useful technique for working with (re- 
peated) geometric vertex decompositions of reduced schemes. 

2.1. Algebraic aspects. Let R = k[xi , . . . , x n , y] be a polynomial ring in n + 1 vari- 
ables over an arbitrary field k. We shall be dealing with Grobner bases, for which 
our basic reference is |Eis, Chapter 15]. Define the initial u-form in y p of a poly- 
nomial p G R to be the sum of all terms of p having the highest power of y. Fix 
a term order -< on R such that the initial term inp of any polynomial p is a term 
in the initial u-form: inp = in(in y p). Let in J denote the initial ideal of J, generated 
by the initial terms in f of all f G J, and let in y J denote the ideal generated by the 
initial u-forms of the elements of J. Thus in (gi , . . . , g T ) D (in g-| , . . . , in g r ), with 
equality if and only if {g^ . . . , g T } is a Grobner basis under -<;. We automatically 
have in(in y J) = in I, by our condition on -<. 

We say that I is homogeneous if it is Z-graded for the grading on R in which 
all of the variables have degree 1 . When I is homogeneous, it has a Hilbert series 
h.R/i(s) = 2^kez dim(R/I)i c - s k . When h and h' are two power series in the variable s 
with integer coefficients, we write h < h/ if for all k, the coefficient on s k in h is 
less than or equal to the coefficient on s k in h'. 

Theorem 2.1. Let I bean ideal in R, and {u^qi+rj™-, a Grobner basis for it, wherey di qi 
is the initial y-form ofy di qt + r t and y does not divide qi. Then the following statements 
hold for 

V = (-y di q i |i = l,...,m), C = (q t | i = 1 , . . . ,m), P = (q t | d t = 0) + (y). 
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a) The given generating sets ofl 1 , C, and P are Grobner bases, and V = in y I. 

b) If maxt dt = 1, then V = C D P and in(C + P) = in C + in P. 

c ) v/p = n V?. 

d) C = (I' : y°°), which is by definition the ideal {f e R | y'f e V for some ) > 0}. 

e) Ifl is homogeneous, then h, R/I (s) > h R / P (s) + s ■ H R / C (s), with equality if and only 
if 'I' = CnP. 

When I' = CflP, we will call this decomposition of I' a geometric vertex decomposition 
ofl. 

Proof, (a) These all follow from |Eis, Section 15.10.4 and 15.10.5]. 

(b) The hypothesis means that I' = yC + (q t | d^ = 0). As the generators of C 
do not involve the variable y, we have yC = C n (y). Hence, using the modular 
law for ideals (that is, c fi (a + b) = cfio + cnbifc^ b), we can conclude that I' = 
C n (y) + C n (qt I di = 0) = C n P. For the equality involving initial ideals, observe 
that C + P = C + (y), so that in(C + P) = in C + (y), and use part (a). 

(c) Let I' = (uq t | di > 1 ) + (qi | di = 0). Then VV D V D I', so by the Nullstellen- 
satz all three ideals have the same vanishing set. Part (b) implies I' = CnP. 

(d) This is elementary, using the fact that I' is homogeneous for the Z-grading in 
which y has degree 1 and all other variables have degree zero. 

(e) It suffices to show that the sum of series on the right hand side of the inequal- 
ity is the Hilbert series of R/(C n P), because (i) C n P D I' by our proof of (c), and 
(ii) the quotients R/I and R/I' have the same Hilbert series. To complete the proof, 
use the exact sequence 

-> R/(C + P) -> R/C © R/P ^R/(CnP)^0 

of R-modules. It implies that 

h-R/(cnP) = h-R/p + (h-R/c — h R /(c+p])- 

The equality C + P = C + (y) yields R/(C + P) = (R/C)/y(R/C). Therefore 
Hr/( C +p)(s) = (1 — s)h R / C (s), because the generators of C do not involve y. □ 

This inequality (e) is used in |KMNI to study schemes whose Hilbert functions 
are smallest, in various senses. 

2.2. Geometric aspects. While the next theorem essentially recapitulates Theo- 
rem l2.1l in geometric language, it is not a verbatim translation. For example, we do 
not assume that coordinates %\ , . . . , x n , y have been given. One of the purposes of 
Theorem l2.2l is to describe the flat limit X' using schemes naturally determined by 
the subscheme X C V and the choice of the line L, namely 17 and A, at least in the 
case where we have a geometric vertex decomposition. 

Let V be a vector space over a field k, viewed as a scheme over k, and suppose 
that a 1 -dimensional subspace L of V has been given. The projectivization V = 
P(V © k), which we view as the projective completion V U PV of V, has a point 
PL e PV. Denote by Bl L V the blow up of P( V © k) at the point PL. The exceptional 
divisor is naturally identified with the projective completion of the quotient vector 
space V/L, and in particular contains a copy of V/L. 
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For each choice of a codimension 1 subspace H C V complementary to L, there 
is an action t • ( h, I) = ( h, tl) of k x on V, which we call scaling L and fixing H. 

Theorem 2.2. Let Xbe a closed subscheme of V and L a '[-dimensional subspace of V. 
Denote by TT the scheme-theoretic closure of the image of X in V/L, and by X the closure 
of X in Bl{V. Set A = X n V/L, where the intersection of schemes takes place in Bl{V. 

a) If H is a hyperplane complementary to L in V, and we identify H with V/L, then the 
flat limit X' := lim t ^ t • X under scaling L and fixing H satisfies 

X'D{Tix{0}) U Ax{0} (AxL). 

b) TTze scheme-theoretic containment in part (a) is an equality as sets. 

c) If (the ideal of) X is homogeneous, then the same holds for TT as well as A, and we 
derive an inequality on Hilbert series of subschemes of V: 

h-x(s) > (1 - s)HnxL(s) + sh AxL (s). 

d) Parts (a) and (c) both become equalities if the flat limit X' is reduced. 

Proof. Pick coordinates Xi , . . . , x n on H and a coordinate y on L, and choose a term 
order on R = k[xi, . . . ,x n ,y] such that in(in y p) = inp for all polynomials p. Let 
I C R be the ideal defining X. Then there exists a Grobner basis for I with respect 
to this term order, and we can apply Theorem l2.1l to study the associated ideals V, 
C, and P. The ideal P cuts out the projection TT C H, while C cuts out the subscheme 
A x L C V. Our claims therefore follow from Theorem l2.ll □ 

Though it is very important in this paper, we did not see how to state Theo- 
rem !2.1l part (b) in a particularly geometric way. We expressed the Hilbert series in 
Theorem I2.2f c) in terms of X, TT x L, and A x L because all three occur in the same 
vector space (once H has been chosen). 

The property of being a geometric vertex decomposition is preserved under (fur- 
ther) degeneration, so long as the schemes stay reduced: 

Proposition 2.3. Let X D D be two reduced closed subschemes o/H x L Let M be a 
1 -dimensional vector space, and define YCHxLxMss 

Y=(Xx{0})U Dx{O }(DxM). 

Use the action o/k x on H x L scaling L and fixing H to define two new flat limits X' 
and D '. Assume that these are again reduced, so they are geometric vertex decompositions. 
Then the flat limit Y' o/Y under the action o/k x onHxMxL scaling L and fixing HxM 
is again reduced, and hence it is a geometric vertex decomposition. 

Proof. By Theorem 12.21 as subschemes of H x L we have 

X' = (TT x {0}) U (A x L) and D' = (Ix {0}) U (F x L). 

Hence the projection and cone parts of Y' are, as subsets of H x M, 

(nx{0})U Ix(O )(IxM) and (A x {0}) U rx{ o} (L x M), 

respectively. Again by Theorem 12.21 we get 

Y'D{Ux {0} x {0}) U (I x {0} x M) U (A x L x {0}) U {V x L x M). 

9 



Our goal is to prove the above containment to be an equality of schemes. 
Rearranging, we see that 

Y' D (TT x {0}x {0}) U (A x L x {0}) U (I x {0} x M) U (T x L x M) 
= (X'x{0})U D , x{ o}(D'xM). 

Since X' and D' had geometric vertex decompositions, the right hand side has the 
same Hilbert series as (X x {0}) Udx{0} (D x M) = Y, which matches that of Y', the 
left hand side. Therefore the containment is an equality. □ 

2.3. Cohomological aspects. Even if the degeneration by rescaling an axis is not 
a geometric vertex decomposition, the limit X' can still be analyzed enough to 
give a useful positivity statement about (multi)degrees. Moreover, it is always an 
equality, not just an inequality like Theorem l2.2l part (c). 

For X a T-invariant subscheme of a vector space V carrying an action of a torus T, 
there is an associated multidegree deg v X living in the symmetric algebra Sym(T*), 
where T* is the weight lattice of T. Our general reference for multidegrees is 
HMSl Chapter 8], though this particular algorithm appears in (jo| |. 

Proposition 2.4. Three axioms suffice to characterize the assignment of multidegrees: 

a) deg { g|{0} = 1 for the zero vector space and the trivial torus action. 

b) If the components ofX of top dimension are Xi, . . . , X k , occurring in X with multi- 
plicities mi , . . . , rrik, then deg v X = Y_\ m i deg v Xt. 

c) If H is a T-invariant hyperplane in V, and X is an irreducible variety, then 

(i) ifX £ H, then deg v X = deg H (X n H). 

(li) ifX C H, then deg v X = wt[V/H) deg H X, where wt[V/H) G Sym^T*) is 
the weight of the T -action on the '[-dimensional representation V/H. 



Proof. That these properties are satisfied by multidegrees follows from |MS, Sec- 
tion 8.5 and Exercise 8.12]. These properties determine a unique assignment by 
induction on the dimension of V: the base case is the first axiom; the second axiom 
reduces the calculation of multidegrees from schemes to varieties; and the third 
axiom brings the dimension down by 1 for varieties. □ 

If T is 1 -dimensional, then Sym codimX (T*) = Z, so deg v X G Sym codimX (T*) is spec- 
ified by a number. If in addition the torus action is by global rescaling on V, so X 
is an affine cone, then this number is the usual degree of the corresponding pro- 
jective variety. This cohomological interpretation is related to the general fact that 
Sym(T*) is the equivariant cohomology ring, and equivariant Chow ring, of V. The 
theorem to follow is already interesting as a statement about usual degrees. 

In an unfortunate collision of terminology, the degree of a morphism 3 X — > Y 
of reduced irreducible schemes over a field k is defined to be the degree of the 
extension k(X) D k(Y) of their fraction fields (if this extension is finite) and zero 



3 Actually, the two are related. If W < V is a generic subspace of codimension dimX, then 
the degree of the morphism X — > V/W is the usual degree of the affine cone X. Such genericity 
is unavailable for most bigger torus actions, and one may view Theorem 12.51 as a version of this 
statement for multidegrees. 
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otherwise. When k is algebraically closed, the degree of X — » Y is simply the 
cardinality of a generic fiber, if this number is finite. 

Theorem 2.5. Let X,X'CHxL and TT, A C H be as in Theorem Assume that X 
is reduced, irreducible, and invariant under the action of a torus T on V, so its projection 
TT C H is, too. Let d be the degree of the projection morphism X — > TT. Then 

deg v X = d • deg v TT + deg v (A x L). 

Moreover, deg v TT = deg v (TT x L) ■ wt[V/H), where wt[V/H) e Sym 1 (T*) is the weight 
of the action of J on the one-dimensional representation V/H. 

Proof. Let us assume that the morphism X — > TT has degree d > 0, for otherwise X = 
TTx L = X', and the result is trivial. The stability of deg under Grobner degeneration 
HMSl Corollary 8.47] implies that deg(X) = deg(X'). Additivity of deg on unions 
HMSl Theorem 8.53] therefore implies, by Theorem I2.21 that deg(X) = deg( A x L) + 
deg (IT), where TT' is the (possibly nonreduced) component of X' supported on TT. It 
remains only to show that deg(TT') = d- deg(TT). This will follow from the additivity 
of deg once we show that TT' — or equivalently, X' — has multiplicity d along TT. 

Let K = k(TT), the fraction field of TT. Given a module M over the coordinate 
ring k[TT] of TT, denote by M n the localization M® k [n] K at the generic point of TT. The 
multiplicity of X' along TT is the dimension of k[X']n as a vector space over K. Now 
consider the flat degeneration X ~> X' as a family over the line with coordinate 
ring k[t], and let M be the coordinate ring of the total space of this family. Thus M 
is flat as a module over k[t]; equivalently, M is torsion-free over k[t]. To prove the 
result it is enough to show that the localization M n is flat over K[t], since taking 
K-vector space dimensions of the fibers over t = 1 and t = yields the degree d of 
X — > TT and the multiplicity of X' along TT, respectively. 

We know that M is flat over k[t], that k[TT] [t] is flat over k[t], and that K[t] is flat 
over k[TT] [t]. A routine calculation therefore shows that Mn is flat over k[t]. On the 
other hand, M is the coordinate ring of the total space of a (partial) Grobner degen- 
eration, so M Cg> k [ t ] k[t, t _1 ] is the coordinate ring of a family over k x that is isomor- 
phic to the trivial family k x x X. Moreover, since the rescaling in our Grobner de- 
generation commutes with the projection to TT, the coordinate ring M ® k [ t ] k[t, t _1 ] 
is free over k[TT] [t, t~ 1 ]. It follows that M n ®K[t] K[t, t~ 1 ] is free over K[t, t~ 1 ]. Conse- 
quently, the K[t] -torsion submodule of M n is supported at t = 0. The K[t] -torsion 
of M n is thus also k[t] -torsion, each element therein being annihilated by some 
power of t. Since Mn has no k[t] -torsion, we conclude Mn is torsion-free, and 
hence flat, over K[t]. 

The claim about deg v TT in the final sentence follows from Proposition I2.4I □ 

We remark that in the setup of Theorem 12 .51 d = 1 is necessary in order to have 
a geometric vertex decomposition. It is not sufficient, as seen in Example II .21 

This theorem is applied in [K2J to affine patches on Schubert varieties. 

For a subtorus S C T, there are two different multidegrees degyX e Sym(T*) and 
degyX e Sym(S*) one could assign to a T-invariant (hence also S-invariant) sub- 
scheme X C V. They are related by the natural map Sym(T*) — » Sym(S*) induced 
from the restriction of characters T* — > S*. 
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The map Sym(T*) — > Sym(S*) can be thought of as specialization of polynomials 
upon the imposition of linear conditions on the variables. The following conse- 
quence of Theorem 12 .51 gives a criterion for one polynomial to be the specialization 
of another. In it, we do not assume any Grobner properties of {u di qi + r-J; hence 
the ideal J here is contained in the ideal C from Theorem |2Tj perhaps properly. 

Corollary 2.6. Let XCHxL, where H has coordinates x-\, . . . ,x n and L has coordinate y. 
Assume that H and L are representations of a torus T, and X is a T '-invariant subvariety. 
Let w G T* = Sym 1 (T*) be the weight of J on L, and S CT the stabilizer ofL, so the map 
Sym(T*) -> Sym(S*) takes? 

Let the ideal I defining X be generated by {y di q\ + T\ | i = 1 , . . . , m}, where y di qi is 
the initial y-form ofy di qi + r t and y does not divide Let J = (q-| , . . . , q m ), and define 
C H t o be the zero scheme of J. If we know that 

• has only one component of dimension dimX — 1, 

• that component is generically reduced, and 

• X is not contained in a union of finitely many translates of H, 

then 

(deg v X)| w=0 = (deg H O)| w=0 . 

Proof. Let 0' be the reduced variety underlying the (dimX — 1 )-dimensional com- 
ponent of 0. By the conditions on 0, deg H = deg H 0'. 

Let A, TT, dbe as in Theorem l2.5l whose conclusion specializes to 

(degyX)| w=0 = (deg H A)| w=0 

since setting w = kills the contribution from TT. 

Let C be the ideal defining A. Then C contains J, so A C 0. The condition 
that X not be contained in a union of finitely many translates of H says that A is 
nonempty, and hence has dimension dim X — 1 . 

Hence ADO', and being trapped between two schemes with the same multide- 
gree, deg H A = deg H 0. □ 

Essentially, this corollary replaces the difficulty of showing that a basis for an 
ideal is Grobner with the difficulty of showing that has only one big component. 
It is used in precisely this form in |KZJ|. 

3. Vexillary matrix Schubert varieties 

3.1. Matrix Schubert varieties. In this subsection we review some definitions and 
results of Fulton on determinantal ideals |Ful[; an exposition of this material can 
be found in |MS, Chapter 15]. 

Let M. n be the variety of n x n matrices over k, with coordinate ring k[z] in 
indeterminates {zy}^. 1 . We will let z denote the generic matrix of variables (zy) 
and let z pxq denote the northwest p x q submatrix of z. More generally, if Z is 
any rectangular array of objects, let Z pxq denote the northwest p x q subarray. 
In particular, identifying n E S n with the square array having blank boxes in all 
locations except at (i, 7t(i)) for i = 1 , . . . ,n, where we place dots, we define the 
rank Tp q to be the number of dots in the subarray 7t pX q. This yields the n x n rank 
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array r n = (Tp q )£ q=1 . We can recover the dot-matrix for n from r^by placing a dot 
at (p, q) whenever Tp q — Tp_ 1>q — Tp q _ 1 + Tp_ l q _ 1 = 1 rather than (by convention, 
we set ro* = r? = 0). 

For 7t G S n , the Schubert determinantal ideal 1^ C k[z] is generated by all 
minors in z pxq of size 1 + Tp q for all p and q. It was proven in |Ful| to be prime. 
The matrix Schubert variety is the subvariety of M n cut out by l n ; thus 
consists of all matrices Z G M n such that rank(Z pxq ) < Tp q for all p and q. 

In fact, the ideal l n is generated by a smaller subset of these determinants. This 
subset is described in terms of the diagram 

D(7t) = {(p,q) G {!,..., n} x {!,... ,n} | 7t(p) > q and7t _1 (q) >p}. 

of 7t. Pictorially, if we draw a "hook" consisting of lines going east and south from 
each dot, then D (tt) consists of the squares not in the hook of any dot. The essential 
set is the set of southeast corners of the connected components of the diagram: 

£ss(n) ={(p,q) G D(7t) I (p + 1,q), (p, q + 1 ) g D(n)}. 

Then with these definitions, we call a generator of 1^ essential if it arises as a minor 
of size 1 + rp q in z pxq where (p, q) G £ss(7r). The prime ideal 1^ is generated by its 
set of essential minors. 

/ l 2 3 4 5 \ 

Example 3.1. The dot-matrix for n = ( 4 ^ 325) e ^ 5 an< ^ ^ a 8 ram D(7t) 
are combined below: 



I 1 1 1 


















r 



The diagram consists of two connected components; we also record the value of 
the rank array r(n) on the essential set. 

The matrix Schubert variety X n is the set of 5 x 5 matrices Z such that z-\-\ = z 12 = 
z 13 = and whose upper left 3x2 submatrix Z3 X 2 has rank at most 1; all other 
rank conditions on Z G X n follow from these. Using only the essential minors, 

ln= (Zll, Z12, z 13, Z11Z22 — Z 2 iZ 12 , Z11Z32 — Z 31 Z 12 , Z21Z32 — Z 31 Z22)- 

These generators form a Grobner basis under any diagonal term order, i.e., one 
that picks zn, z 12 , z 13 , znz 2 2, Z11Z32/ and Z21Z32 as the leading terms. This statement 
is an instance of the main result of this section, Theorem 13.81 

3.2. Vexillary permutations. Since we shall be interested in vexillary matrix Schu- 
bert varieties, we collect in this subsection some results on vexillary permutations. 

A permutation n is called vexillary or 2143-avoiding if there do not exist integers 
a < b < c < d such that 7t(b) < Ttfa) < 7t(d) < 7t(c). Fulton characterized these 
permutations in terms of their essential sets: no element (p, q) of the essential set 
is strictly northwest of another element (i, j), meaning p < i and q < j. To each 
vexillary permutation n G S n we associate the partition A(7t) whose parts are the 
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numbers of boxes in the rows of D{n), sorted into weakly decreasing order. For 
example, the permutation n in Example 13. H is vexillary, and A(7t) = (3, 1 ). 

Every Grassmannian permutation (see the Introduction) is vexillary; in fact, a 
permutation is Grassmannian if and only if its essential set is contained in one 
row, necessarily the last nonempty row of the diagram. In this case, A(7t) simply 
lists the number of boxes in the rows of D(7t), read bottom-up. 

In Corollary 13.31 we will collect the characterizations of vexillary permutations 
that we will need, one based on this. 

Lemma 3.2. Let n G S n and (i, j) G D(7t). There exists (p, q) G Sss{n) with p < i and 
q < j if and only if the dots ofn^_^ x do not form a diagonal of size r^. 

Proof. This is straightforward from the definition of essential set. □ 

Corollary 3.3 (|FulI). The following are equivalent for a permutation n G S n . 

a) 7i is vexillary. 

b) There do not exist (p, q) G £ss(7t) and (i, j) G £ss(7r) wif/z p < i and q < j. 

c) For flZZ (p, q) G D(7t), the dots of '7t( p -i) X (q-i) form a diagonal of size r£ q . 

Proof. The equivalence of (a) and (b) comes from |Ful, Section 9]. Since every ele- 
ment of D(7t) has an element of £ss[n) to the southeast of it in its connected com- 
ponent, the equivalence of (b) and (c) comes from Lemma I3~21 □ 



For any permutation n, call a box (p, q) G D(7t) accessible if r pq ^ and no 
boxes other than (p, q) itself lie weakly to its southeast in D(7t). In particular, 
(p, q) G £ss{n). Our next goal is to define, for a vexillary n and an accessible 
box (p, q), two new vexillary permutations tx p and n c . 

For any permutation n, each connected component of D [it] has a unique north- 
west corner (a, b). If 7t is vexillary and (a, b) ^ (1,1), then there is a dot of n at 
(a — 1 , b — 1 ), because Corollary 13 .31 prevents pairs of dots of n weakly northwest 
of (i, j) from forming antidiagonals. Let (t, 7t(t)) = (a — 1 , b — 1 ) be the dot of n 
adjacent to the northwest corner of the connected component of D(7t) containing 
(p, q). Now set 

(1) 7T P = 7to (p,7t _1 (q)) and 7r c = 7r P o (t,p), 

where the composition o (i, j ) with the transposition (i, j ) results in switching rows i 
and j. Denote the corresponding rank matrices by r p = r np and r c = r nc . 
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/ 1 2 3 

Example 3.4. The permutation n = I g ^ 
dot-matrix and diagram are combined below: 



4 
6 



5 
2 



6 
9 



8 

3 



is vexillary. Its 
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The box (p, q) = (7,4), which is marked with r/ 4 = 2, is accessible, and the dot 
immediately northwest of its connected component is (t, 7t(t) ) = (5,2). Therefore 



7T P 



123456789 
871 629435 



and 7r c 



123456789 
871 649235 



These correspond respectively to 
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Lemma 3.5. Let nbea vexillary permutation, r n its rank matrix, and (p, q) an accessible 
box for n. Then the following hold. 

a) D(7r P )=D(7r)\{(p,q)}. 

b) D(7r c ) is obtained by moving diagonally northwest by one step the rectangle con- 
sisting of boxes of D [n) weakly northwest of (p , q ) and in its connected component. 

ifv < i- < 71-1 (q) — 1 an & q < j < 7t(p) — 1 
otherwise. 



c r f. 



d) 




if t < i < p - 
otherwise. 



1 and 7t(t) < j < q — 1 
! (q) — 1 and q < j < 7t(p) — 1 



e) £ss[n) \ {(p, q)} C £ss{n P ) and £ss(7t P ) \ £ss(7t) C {(p 

f) £ss(7t c ) = {€ss(n) \ {(p, q)}) U {(p - 1 , q - 1 )}. 

g) 7T P and n c are vexillary permutations. 
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l,q),(p,q-l)}. 



Proof. Parts (a)-(f) are straightforward to check from the definitions. Part (g) fol- 
lows easily from parts (a) and (b) combined with the equivalence of Corollary I3.3f a) 
and Corollary 13 .3f b). □ 



Example 3.6. Continuing Example l3.41 omitting the 2's to better see the shapes, and 
omitting the 5's, 6's, 7's, 8's, and 9's (which don't change), we have 







/0 ] 1\ 
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1 
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4 
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3 
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1 1\ 



3 
4 



/ 





11111 



1111 



3 
4 
4 



3 
3 
4 



1 

3 
4 
4 



3 
4 



/0 1 1\ 

1 

1 1 . 
1 



and 



1111 
1111 



1 1 

1 1 

1 . 

1 . 



V 



3 
4 
4 



3 
3 
4 



3 
4 
4 



3 
4 



These rank arrays r p and r c are in agreement with Lemma 1331 

Finally, we see how to get vexillary permutations from Grassmannian ones. 

Lemma 3.7. Let n e S n be vexillary permutation with largest descent position k. Then 
there exists some N > n and a sequence of vexillary permutations 

m Sn, tfZZ wif/t largest descent position k, sue/? i/zai <Ti is Grassmannian and o" i+1 = (oi)c 
/or 1 < i < t — 1 . T/?e permutation tc= cti is uniquely determined by n; in fact, 

{(k,k — p + q) | (p, q) e £ss(7t)} and r£ ik _ p+q 



£ss(7t) 



k - p + r?, 



pq- 



Proof. There is nothing to prove if rt is Grassmannian. Otherwise we construct a 
vexillary permutation <r as follows. Find the second largest descent i < k of it. 
Hence the rightmost box (i, j) of D(tt) in row i lies in £ss[n). Since n is assumed 
to be vexillary, all boxes of £ss{n) to the north of (i, j) are weakly to the east of 
column j. Find the northmost box in £ss(7t) that is in column j, say (H, j). 

Since (h, j) e fss(7r), there are dots (h + 1 , q) and (p, j + 1 ) of 7t satisfying q < j 
and p < H. Since 7t is vexillary, there are no boxes of the diagram D(7t) strictly 
southeast of (h, j). This implies that there is a unique northwestmost dot (c, 7t(c)) 
of n strictly southeast of (H, j); that is, no two dots of n strictly southeast of (H, j) 
form an antidiagonal. 
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Now let = no (p, h. + 1 ) o (H + 1 , c). Then one checks that D(cr) is obtained 
from D (tt) by moving the boxes in the rectangle in row p to h and columns q and j 
southeast by one unit. Our choices guarantee that a is still vexillary, by looking at 
£ss[cr) and using Corollary I3.3I Moreover, A(cr) = A(7t) because the number of rows 
with any given number of boxes of the diagram is the same for both n and ex. Also, 
still has its last descent at position k. Most importantly, (h. + 1 , j + 1 ) G £ss(<r) is 
accessible, and n = a C - 

Note in particular that the boxes of cr are further south than those of n (and 
strictly so in at least one case). Therefore, repeated application of the above con- 
struction successively moves the boxes of D(7t) south, but always above row k. So 
this gives a chain of permutations starting with n and eventually ending with a 
Grassmannian permutation in some Sn with N > n. 

The final sentence of the lemma follows from parts (d) and (f) of Lemma 1331 □ 

3.3. Diagonal Grobner bases. In |KM1 1 it was proved that for any permutation n, 
the essential minors form a Grobner basis of the Schubert determinantal ideal l n 
under any anfzdiagonal term order. We prove here a complementary result for 
diagonal term orders, assuming that the permutation n is vexillary (Theorem 13.81 1; 
in Section |6] we explain the sense in which this diagonal Grobner basis result is 
sharp. Our proof will be an application of Theorem 12. II 

Theorem 3.8. Ifn G S n is a vexillary permutation, then the essential minors ofl n consti- 
tute a Grobner basis with respect to any diagonal term order. 

The proof will be by an induction based on Lemma |3~7I and the following, which 
connects the notation of Theorem 12.11 with Eq. Q. Geometrically, Proposition 13.91 
concerns the decomposition M n = H © L where H consists of all matrices satisfying 
z pq = for some fixed accessible box (p, q) G £ss[n), and L is the 1 -dimensional 
space of matrices with all zy vanishing except Zp q . 

Proposition 3.9. Let nbea vexillary permutation and (p, q) G £ss{n) an accessible box. 
Fix a diagonal term order -< on k[z]. Suppose that the essential minors generating I = l n 
form a Grobner basis with respect to -<, set z pq = y, and let V, C, P, and their respective 
generators be as in Theorem \Tl\ Then the following hold. 

a) C = l nc and P = 1^ + (zpq), where n c and 7i P are defined by Eq. ©. 

b) The generators of C and P are Grobner bases for these ideals under -<. 

c) The essential minors generating l nc form a Grobner basis under -<. 

d) I' = C fl P is a geometric vertex decomposition. 

Proof. Separate the set of essential minors generating I into sets V and U accord- 
ing to whether they do or do not involve Zp q . Since (p, q) is accessible, the array 
of z-variables appearing in an essential minor that involves Zp q has southeast cor- 
ner Zp q . 

For each minor in V, put into a new set V the one-smaller minor obtained by 
removing the last row and column. Define z pq V' by multiplying all elements of V 
by Zpq. Then, by definition of Grobner basis, I' is generated by UU (z pq V'), whereas 
C is generated by U U V and P is generated by U U {z pq }. 

17 



It follows from parts (c) and (e) of Lemma l3~5l that the essential minors for 7tp are 
precisely the determinants in U. Hence the statement about P in part (a) follows. 

Next we check that C C I nc . Each minor in U comes from a (possibly inessential) 
rank condition from r n corresponding to either 

(i) a box of D(7r) \ {(p, q)} in the same connected component as (p, q) and in 
row p or column q, or 

(ii) a box in £ss(7t) \ {(p, q)}. 

In either case, Lemma I3.5f d) shows that r nc and r 71 are equal at these positions. 
Hence each minor in U lies in 1^. Also, any minor in V arises from the rank 
condition corresponding to (p, q) e £ss[n), and the associated minor in V is an 
essential minor corresponding to Tp l q lr by parts (d) and (f) of Lemma [331 Thus 
we obtain V C l nc , and soliUV'C 1^ . Therefore CC I nc . 

To show the other inclusion, one checks from Lemma 13.51 that if an essential 
minor comes from (p — 1 , q — 1 ) e £ss(7t c ) then it lies in V; otherwise, it lies in U. 
This concludes the proof of part (a). 

Theorem 12.11 guarantees that the generating sets for C and P are again Grobner 
bases. Since minors have only squarefree terms, the power of z pq in each generator 
is at most 1 , so the theorem also tells us we have a geometric vertex decomposition. 
This proves parts (b) and (d). 

It remains to check part (c). Although 1^ = C, there are minors in U U V that are 
not essential minors for 1^ . These are exactly those minors in U arising from (i) 
above. Thus we wish to show that we can remove these inessential minors and still 
have a Grobner basis. Since 1^ is generated by its essential minors, it suffices to 
check that the leading term of each minor from (i) is divisible by the leading term 
of an essential minor in 1^ . For this, note that removing the last row and column 
from one of these inessential minors yields a minor of smaller degree that is an 
essential minor of 1^ arising from Tp_i q _i. □ 

Proof of Theorem \3.8\ Construct a chain of vexillary permutations as in Lemma I3~71 
If 7i = CT|, so n is Grassmannian, then the result is proved in WCGGilStu l. This case 
can also be derived from |KM1 , Theorem B], which proves the Grobner basis prop- 
erty for antidiagonal term orders, because the set of essential minors for a Grass- 
mannian permutation with unique descent k is invariant under the permutation of 
the variables induced by reversing the top k rows of z (since the essential set of n 
lies entirely in the k th row of D(tt)). If n ^ cr-| then the desired statement holds by 
induction on the length of the sequence in Lemma I3~71 using Proposition I3.9f c). □ 



4. Stanley-Reisner ideals and subword complexes 

Theorem 13.81 shows that for a vexillary permutation n E S n , the initial ideal 
in l n is a squarefree monomial ideal; this makes it the Stanley-Reisner ideal of a 
simplicial complex whose vertices are [n] 2 = {(p, q) | 1 < p, q < n} and whose 
faces consist of those subsets F such that no monomial from in l n has support F. 

In this section we prove this complex to be a subword complex |KM2[; besides 
its intrinsic interest, we apply this fact toward combinatorial formulae in the next 
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section. Without introducing subword complexes, though, our geometric technol- 
ogy is already sufficient to prove that this complex is shellable. 



Theorem 4.1. Let n be a vexillary permutation, and V the simplicial complex whose 
Stanley-Reisner ideal is in l n . Then V is shellable. 

Proof. If J is a Stanley-Reisner ideal in k[z], let F(J) denote the corresponding sim- 
plicial complex on the vertex set [n] 2 , so F = F(in 1^). 

By Proposition I3.9l part (d), has a geometric vertex decomposition into fl 
{zpq = 0} and X nc , where (p, q) is an accessible box of n. By Proposition 12.31 this 
geometric vertex decomposition of X^ degenerates to a geometric vertex decompo- 
sition of in l n into in l np + (z pq ) and in 1^ . As explained in Example II .31 this gives 
an ordinary vertex decomposition of F(in 1^) at the vertex (p, q) into the deletion 
P(in l np + (z pq )) and the cone F(in L^, ) on the link. 

Since the ideal in l np doesn't involve the generator z pq , the complex F(in 1^) is 
the cone on F { i n 1^ + (z pq ) ) at the vertex (p , q ) . In particular, one is shellable if and 
only if the other is. 

Using induction on the position of the most southeastern box in the diagram, 
P(in l nc ) and F(in l np ) are both shellable; hence F(in 1^ + (z pq )) is also. As noted in 
I BP |, one can concatenate a shelling of the deletion F(in 1^ + (z pq )) and a shelling 
of the cone F(in 1^ ) on the link to make a shelling of P( in I^). □ 

We review some definitions about subword complexes from |KM21; see also 
IIMSl Section 16.5], which covers the generality here. A word of size t is an or- 
dered sequence Q = (s^, , . . . , s it ) of simple reflections = (i, i + 1 ) £ S m . An 
ordered subsequence P of Q is a subword of Q. In addition, P represents p 6 S m if 
the ordered product of the simple reflections in P is a reduced decomposition of p. 
We say that P contains p G S m if some subsequence of P represents p. Let A(Q, p) 
denote the subword complex with vertex set the simple reflections in Q and with 
faces given by the sub words Q \ P whose complements P contain p. 

Using the above setup, we now define the subword complex V n for a given vex- 
illary permutation n £ S n . Let \i{n) = ( (a. n > (j, 2 > ... > (Xk > 0) be the partition 
with the smallest Ferrers shape (in English notation, i.e. the largest part along the 
top row) containing all of the boxes of D(7i); thus the shape of |x(7t) is the union 
over (p, q) £ £ss(7r) of the northwest p x q rectangles in the n x n grid. Fill each 
box (p, q) in the shape of \x{n) with the reflection Sk_ p+q . Reading each row of \jl{tx) 
from right to left, starting with the bottom row and ending with the top row yields 
the word 

Q — (S|o- k > • • • i Si , Si-|_m._-| , . . . , S2, • • • , Si+i^ > • • • i Si+1 1 • • • ) Sk—i+ij/i > • • • i S]c) • 



Let 7tbe the Grassmannian permutation from Lemma l3~7l and set V n = A(Q, n). 




row k 



row k— 1 



row k— i 



top row 
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/ 1 2 3 4 5 \ 

Example 4.2. The vexillary permutation n = [ ^ ^ 5 ) e ^5 rrom Exam- 
ple |3]T]has \i{n) = (3,2,2) and tc=^| ^ g \ 4 5 ^ e ^ N ^ or N = 6. The 
ambient word for V n is Q = (s 2 , Si, s 3 , s 2 , s 5 , s 4 , s 3 ). 

Lemma 4.3. Identify \x{n) with its Ferrers shape. Setting to 1 G k aZZ variables z pq /or 
(p , q ) outside of [i{n) takes any generating set for in 1^ to a generating set for in 1^. 

Proof. It suffices to check that (i) every diagonal generator of in 1^ can be obtained 
from some diagonal in in I„by setting the variables outside of \i-{n) to 1, and (ii) set- 
ting the given variables to 1 in any diagonal from in I„ yields an element inside in 1^. 
For (i), if 5 is a diagonal generator of l n , say of degree 1 + r£ q using the variables 
z pX q for (p, q) G £ss[n), then simply multiply 6 by the diagonal z 1+Pjl+q • • • z kjk _ p+q 
to get a diagonal generator of in I„. For (ii), observe that any diagonal of size at 
least j + 1 + rp q using the variables z { j +p ) x( j +q ) has at least 1 + Tp q of its variables 
weakly northwest of Zp q , and take j = k — p for (p, q) G £ss{n). □ 

Theorem 4.4. Let n G S n be a vexillary permutation. With respect to any diagonal term 
order, the initial ideal ofl n is the Stanley-Reisner ideal for the subword complex V n . 

Proof. Let n be the Grassmannian permutation defined in Lemma 13.71 If 71 = n 
then the result follows from |KM1, Theorem B and Example 1.8.3], which proves 
the corresponding result for the anf z'diagonal initial ideal of 1^, because the set of 
essential minors for 1^ is invariant under the permutation of the variables induced 
by reversing the top k rows of z. 

For general vexillary n, let us write = A(Q,7t), to distinguish the word Q 
from Q. Given a subword P of Q, denote by zp the set of variables corresponding 
to the locations of the boxes occupied by P. The previous paragraph yields the min- 
imal prime decomposition in 1^ = f] p (z P ), the intersection being over subwords P 
of Q representing n. Since in 1^ is a monomial ideal, setting the variables outside 
of p(7t) to 1 G He and omitting those intersectands (z P ) that become the unit ideal 
yields a prime decomposition, and it is a decomposition of in 1^ by Lemma 14.31 
(The intersections for in I„ and in 1^ are taken in different polynomial rings, but 
this is irrelevant here.) The intersectand (zp) for a subword P C Q representing n 
survives the process of setting the variables outside of p(7t) to 1 if and only if P is 
actually a subword of Q. □ 

In the next section, we will use a pictorial description of V n , developed in |FK2, 
IBBl IKJVlIII (see IMS! Chapter 16] for an exposition). Let n be vexillary, and again 
consider the Grassmannian permutation n G Sn with descent at k. A tiling of the 
kxN rectangle by crosses — |— and elbows is called a pipe dream. (Warning: the 
elbow tile here is mirror-reflected top-to-bottom from the above references. This is 
traceable to our use of diagonal, rather than antidiagonal, term orders.) It is often 
convenient to identify a pipe dream with its set of — |— tiles, and to identify each 
subword P of Q with the pipe dream whose crosses lie at the positions occupied 
by P. When P represents n, so the number of crosses equals the length of n, then P 
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is a reduced pipe dream (or an "rc-graph") for n. In this language, the initial ideal 
in l n is described as follows, by |KM1, Example 1.8.3]. 

Corollary 4.5. Q \ P is a face ofT n if and only if (i) the crosses in the pipe dream P lie in 
the Ferrers shape \i[n), and (ii) P contains some reduced pipe dream representing n. 

Example 4.6. Recall the situation from Example 14.21 The following pipe dream P 
corresponds to the subword (s 2 , • , • , -,85,54, S3) of Q, and Q \ P is a facet of 1"^. 

















m 



















123456 123456 

By Example ED in Itt = (zn, z Ul zi 3 , Z21Z32) = (zn,z 12 ,z 13 ,z 21 ) n (z 11 ,z 1 2,z 13 ,z 3 2). 
Thus there is only one remaining facet Q \ P' of corresponding to the (reduced) 
pipe dream P' obtained by moving the — |— at (3,2) diagonally northwest to (2, 1 ). 

If we follow the three pipes from the left side to the bottom, they come out in po- 
sitions 1,3,6. These are the positions of the "up" moves in the word "up, right, up, 
right, right, up" describing a walk around the partition (3,1,0) from the southwest 
corner to the northeast. 

We could have waited to prove Theorem 14.11 until after proving that the initial 
complex is a subword complex, and then using the combinatorially proven fact 
from |KM2j that subword complexes are shellable, instead of using geometric ver- 
tex decompositions. In |K2| we will reverse this argument, and use geometric 
vertex decompositions to prove once more that subword complexes are shellable. 



5. Flagged set- valued tableaux 

5.1. Set-valued tableaux and Grassmannian permutations. Formulae for certain 
Grothendieck polynomials associated to a partition A were given by Buch |Buc[ 
(see Corollary 15.91 below). Naturally generalizing the tableau formula for Schur 
polynomials, he gave his formula in terms of (semistandard) set-valued tableaux 
with shape A. These are fillings t : A — > PowerSet(N) of the boxes in the shape 
of A (in English notation, the largest part along the top row) with nonempty sets of 
natural numbers satisfying the following "semistandardness" conditions: 

• if box b G A lies above box c G A, then each element of t(b) is strictly less 
than each element of t(c); and 

• if box b G A lies to the left of box c G A, then each element of T(b) is less 
than or equal to each element of t(c). 

Let SVT{\) denote the collection of all such tableaux for a partition A, as the non- 
semistandard ones will be of little interest in this paper. (They are more pertinent 
in IIKMYII .') For t g SVT[X), let |t| denote the number of entries, so |t| > |A| with 
equality exactly for ordinary (non-set-valued) tableaux. 
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Example 5.1. The following is a set-valued tableau t 6 S , I / T(A) for the partition 
A = (7,6,4,3,1): 



1 


1 


1 


1 


1 


1 


1 


2 


2 


2 


2 


2 


2 




3,4 


4 


4 


4 






5 


5,6 


6 








6,7 


7 











The goal of this section is to generalize and refine Buch's formula by way of a 
Grobner geometry explanation in terms of Theorem 13 .81 The combinatorial aspect 
of this story consists of a bijection between a certain set of pipe dreams and a 
certain collection of set-valued tableau. This generalizes the bijection between 
(ordinary) semistandard Young tableaux and reduced pipe dreams for Grassman- 
nian permutations (Proposition 15.31 below), which we learned from Kogan |Kog[ 
(on the other hand, see Example l5.10l) . 

We begin with the bijection CI from tableaux to pipe dreams. Since its definition 
is just as easy to state for set-valued tableaux, we work in that generality from the 
outset. Define CI by associating to every x e SVT(\) a pipe dream as follows: 

For each integer i that x assigns to the box b, place a — |— in row i so 
that it lies on the diagonal containing the box b. 



Example 5.2. The set-valued tableaux x in Example |5J] maps to 



1 2 3 4 5 6 7 



Proposition 5.3. Ifn e S N is a Grassmannian permutation with descent at kand associ- 
ated partition A = A(tc) / then CI induces a bijection from the set of (ordinary) semistandard 
tableaux of shape A with entries at most k to the set o/k x N reduced pipe dreams for n. 
Moreover, in each k x N reduced pipe dream for n, the following hold. 

a) No pipe passes horizontally through one -\- tile and vertically through another. 

b) The row indices of the — \- tiles on the i th horizontal pipe from the top in Cl{x) are 
the values assigned by x to the boxes in row i of A. 

c) The — |— tile in Cl{x) corresponding to the box b o/A lies on the same diagonal as b. 

d) The box in row p and column q o/A corresponds to the-\- in Cl{x) at the intersection 
of the p th horizontal pipe from the top with the q th vertical pipe from the left. 

Example 5.4. Consider the ordinary semistandard Young tableaux t obtained from 
the set-valued tableaux t in Example 15 .ll by taking only the smallest entry in each 
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box. Then, drawing the horizontal pipes (with small bits of their crossings through 
vertical pipes to make the picture easier to parse), CI sends x to 



/ 



ci 
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10 11 12 13 14 
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The three boxes containing elbow tiles will be explained in Example 15.61 

Proof of Proposition 15.31 Let t be a semistandard tableau of shape A with entries at 
most k. Construct a new tableau T (of shape A + p, where p = (k, k — 1 , . . . , 2, 1 )) by 
adding to the i th row an extra box filled with j for each j = i, . . . , k (and arranged 
to be increasing along each row). The map x — ) Cl{x) factors as x i— > T i— » Cl(x), 
where each box (p , q ) of T filled with j corresponds to a tile at ( j , q ) : the tile is a — |— 
if (p, q + 1 ) is filled with j and a -j- otherwise. The tiles in Cl{x) not assigned by T 
are all -|- tiles. 

The semistandard condition on T guarantees that each -j- arising from the last j 
in a row of T has another due south of it. Hence there is a single pipe such that 
the numbers in row i of T list the row indices of the tiles in Cl{x) entered from the 
left by that pipe. As every — |— in Cl[x) arises from T, this proves parts (a) and (b). 
Part (c) follows easily from (b) by considering each row of T separately and using 
induction on the number of boxes in any fixed row. Part (d) follows from part (a), 
since the horizontal pipes can't cross one another, and nor can the vertical pipes. 

It remains only to show that CI induces the claimed bijection. As the numbers 
of the indicated tableaux and reduced pipe dreams are equal (both agree with the 
evaluation at (!,...,!) of the Schur polynomial s\[x-\ , . . . , Xk)/ which equals the 
Schubert polynomial &n[x-\ , . . . , x^)), it is enough to show that Cl[x) is a reduced 
pipe dream for fc. This follows because Cl(x) has jA| = lengthen) crossing tiles, 
and the pipe entering horizontally into row i exits vertically out of row k through 
column k — i + A t = n{i), as can be seen by counting its — |- tiles. □ 



Subword complexes are homeomorphic to balls or spheres, as shown in |KM2, 
Theorem 3.7], where the interior and boundary faces were characterized. Here, the 
subword complex is = A(Q, n) for the full kx N rectangular word Q. 

Theorem 5.5. IfneS-^is Grassmannian with descent at k and partition A = A (re), then 
CI bijects the set SVT^{\) of set-valued tableaux of shape A with entries at most k to the 
set o/k x N pipe dreams P whose elbow tiles form the vertex sets of interior faces of V^. 

Proof The pipe dream Cl{x) for t e SVT^A) has crosses in at most k rows because 
the entries are at most k, and Cl{x) has at most N columns because A fits in a rectan- 
gle of size k x (N — k). No entry appears twice in t along any diagonal of A. This 
together with semistandardness implies that CI is injective into its image. What 
remains is to show that the image of CI consists precisely of the interior faces of V^. 
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For ordinary tableaux t and facets £l(f) of V^, this is Proposition 15.31 For arbi- 
trary t G SVT^A), there is an associated ordinary tableau t obtained (as in Exam- 
ple |53J by taking only the smallest entry in each box. We will show that, similarly, 
for each subword P of Q such that Q \ P is an interior face of P^, there is an as- 
sociated reduced subword P representing n. To complete the proof, we will then 
construct the set-valued tableau T satisfying O(t) = P starting from the ordinary 
tableau % satisfying Cl[r) = P. 

For a reduced pipe dream P, say that a -j- tile in P is absorbable into P if the 
two pipes passing through it intersect in a— |— tile to its northwest (see Example l5.61 
below). It is immediate from the definition that a tile is absorbable if and only if 
the corresponding reflection in Q \ P is absorbable in the sense of |KM2 , Section 4]. 
Therefore it follows from |KM2, Theorem 3.7] that a pipe dream P is the comple- 
ment of an interior face Q \ P of if and only if P is obtained from a reduced pipe 
dream P for re by changing some of its absorbable tiles into — |— at will. 

Proposition I5.3f a) allows us to distinguish between horizontal and vertical pipes 
in any reduced pipe dream P for n. We claim that if a horizontal and vertical pipe 
cross at -|— and pass through a -|- tile southeast of it, then the -j- lies on the same 
diagonal as the — |— and occurs in a row that is strictly north of the next — |— down 
(if there is one) on the vertical pipe. This suffices because altering such tiles 
to — |— tiles corresponds, by defintion of CI, to inserting extra entries in the box of T 
corresponding to the original— |— tile of P. The claim holds because once the vertical 
pipe passes downward through the next horizontal pipe, that next horizontal pipe 
separates the vertical pipe from the original horizontal pipe. □ 

Example 5.6. The shape A in Examples 15.11 and I5.4l is A(7t) for a Grassmannian per- 
mutation re G Sn=i4 with descent at k = 7. The absorbable tiles in Example 15.41 lie 
in the boxes at (4, 2), (6, 4), and (7, 3). Altering these to — |— tiles yields the nonre- 
duced pipe dream in Example 15.21 as in the proof of Theorem l5.51 these absorbable 
tiles also correspond to the extra entries needed to make the set-valued tableau in 
Example 15 . 1 1 from the ordinary tableau in Example 15.41 

5.2. Flaggings. Given a partition A, a flagging f of A is a natural number assigned 
to each row of A. Suppose that A = A(7t) for some vexillary permutation n, and 
recall the partition \i[n) from Section |U The flag i n assigns to row i of A the row 
index of the southeastern box of that lies on the same diagonal as the last box 
(i, Ai) in row i of A. 

If f is a flagging of A, call a set-valued tableau t flagged by f if each box b in the 
i th row of A satisfies maxT(b) < f (i). In particular, if t is an ordinary tableau (each 
set a singleton), this definition of flagged tableaux is the usual one, in IWacll , for 
example. Let FSVT{n) denote the collection of set-valued tableaux of shape A(7t) 
flagged by f n . Also, let FT{n) denote the subset consisting of flagged semistandard 
(ordinary) tableaux, in which, by definition, all the sets are singletons. 

Example 5.7. If n is the vexillary permutation from Example 13.41 then A(7t) is the 
partition from Example 15.11 and the tableau t in Example 15.11 obeys the flagging 
f n = (1,2,4,6,7); that is, T lies in FSVT[n). In general, the flag of a vexillary 

24 



permutation need not list the indices of the nonempty rows of D(7t); indeed, for 
the permutation n c in Example 13.41 the flagging is f nc = (1,2,4,6,6). 



Let x = (xi , X2, . . .) and y = (yi , t)i, ■ • •) be two collections of commuting inde- 
terminates. To any permutation n G S n , Lascoux and Schiitzenberger associated 
a (double) Grothendieck polynomial Q n [~x., y) IILSH . Our convention here is that 
Q n {x,y) means the same thing as in |KM1J, which would be called ^(x, y _1 ) in 
|KM2[, and is obtained from the polynomial called £>^\y,x) in |FK1[ by replac- 
ing each x and y variable there with 1 — x and respectively. Let ©^(x, y ) denote 
the (double) Schubert polynomial, which is the lowest homogeneous degree com- 
ponent of £?7t(l — x , 1 — y) when this rational function is expressed as a series in 
positive powers of x and y. These double Schubert polynomials are the same as 
those in |KM1 1. Combinatorial formulae for Schubert and Grothendieck polynomi- 
als are known in terms of pipe dreams |FK2], and Grobner geometry explanations 
of these formulae were given in IKMUIKM211 . However, the approach given there 
does not explain the tableau formulae given here, which are different and only ap- 
ply when 7t is vexillary. Hence we now give a Grobner geometry explanation of 
these tableau formulae. 

Theorem 5.8. If n G S n is a vexillary permutation, then CI bijects the facets and interior 
faces ofV n with FT{n) and FSVT[n), respectively. Consequently, we have the following 
formulae for the double Schubert and double Grothendieck polynomials associated to n: 

©7t(x,y) = Y\ ( X val{e) — Vval(e)+j(e)) 

&(x,y) = z_ H) w - w no — 7 ^ ± -) 

reFSVT(n) eST V val(e)+i(e) 

where each product is over each entry e of t, whose numerical value is denoted val(e), 
and where )[e) = c(e) — r(e) is the difference of the row and column indices. The sign 
(_1 )M-|A| alternates with the number of "excess" entries in the set-valued tableau. 

Proof. Let n be the Grassmannian permutation of descent k associated to n by 
Lemma 13.71 The image under CI of FSVT{n) consists exactly of the pipe dreams 
in CliSVT^) whose — |— tiles all lie inside the Ferrers shape \i{n). Therefore the first 
sentence follows immediately from |KM2, Theorem 3.7] and Theorem 15.51 



Consider the Z 2n -grading on k[z] from Section [L6l The desired double Grothen- 
dieck polynomial equals the Z 2rL -graded if -polynomial of the quotient ktzj/I^ by 
|KM1, Theorem A]. This statement holds for k[z]/in l n , too, since if -polynomials 
are invariant under taking initial ideals [MS , Theorem 8.36]. On the other hand, the 
Z 2n -graded if -polynomial of k[z]/in l n is obtained from its Z n -graded counterpart 
by replacing Zp q with x p /y q . Using the definition of V n as a subword complex, one 
calculates the Z n2 -graded if -polynomial of k[z]/in 1^ as in BKM21 Theorem 4.1]: 
it is, by |KM2, Theorem 3.7], the sum over the pipe dreams P corresponding to 
interior faces Q \ P of V n of products (—1 ) |p| ~ £ Yl( v q)epC — z va)> where i = |D(7t)| 
is the length of n. The formula for ^(x, y) results because, by definition of CI, 
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the summand ElbeA^) w ^yW for t G FSVT{n) equals the appropriately signed 
product of factors (1 — x p /y q ) over all (p, q) such that H(t) has a -|— tile at (p, q). 

Substituting 1 — x p for x p and 1 — y q for y q in w^ y (b) results in a power series 
whose lowest term has degree equal to the cardinality of T(b). Taking the lowest 
degree terms in Q n {l — x, 1 — y) therefore yields a sum over honest (that is, not 
set-valued) tableaux, and the formula for ©^(x, y) follows. □ 

In particular, we obtain a Grobner geometry explanation of the following result 
due to Buch |Buc, Theorem 3.1]. 

Corollary 5.9 (|Buc|). Ifn is a Grassmannian permutation and A = A(7r), then 

£ A (1-X)= Y- ("I)'™"' EI X -'(e)> 
r£SVT(X) eet(b) 

where Q\{1 — x) is obtained from GaI*-, y) by replacing each x p andy q with 1 — x p and 1 . 

Example 5.10. We emphasize that our proof of Theorem 15 .81 is a consequence of the 
Grobner geometry, but it is not a direct combinatorial consequence of the Fomin- 
Kirillov formulae |FK1, FK2[. We leave it as a challenge to find such an expla- 
nation, even in the case of double Schubert polynomials. For example, let n = 
( 1 2 3 4 \ 

I 1 4 3 2 j ' ^ en ^( 7T ' = (2, 1 ) an d fn = (2, 3). Theorem |5l| computes 

S n {x,y) = (^2-y2)(x 2 -y 3 )(x 3 -y2) + (^l -yi)(^2-y3)(^3-"y2) 

+ (*i -y2)(x 3 -y2) + (xi -yi)(x 2 -y 1 )(x 2 -y 3 ) 

+ (*i -yi)(xi -y2)(x 2 -yi). 

On the other hand, using the formula of |FK2[ gives 

©7r(x,y) = (xt -y 3 )(x 2 -y 1 )(x 3 -y 1 ) + (xt -y 2 )(x! -y 3 )(x 3 -y0 

+ (^2-yi)(x 2 -y 2 )(x 3 -y!) + (x! -y2)(x 2 -yi)(x 2 -y 2 ) 

+ (xi -y 2 )(x! -y 3 )(x 2 -y 2 ). 

One approach to relating these two formulae would be to prove that after any per- 
mutation of the rows, the essential minors remain a Grobner basis for any diagonal 
term order. Then each permutation of the rows would give a different formula, 
and one might be able to relate the formulae associated to permutations that are 
adjacent in Bruhat order. The two formulae above correspond to the identity and 
long-word permutations of the rows. 

6. The diagonal Grobner basis theorem for Schubert ideals is sharp 



Our goal in this section is to prove the converse of Theorem! 

Let denote the union over all (p, q) G £ss{n) of the sets of minors of size 1 +r pq 
in the northwest p x q coiner z pxq of the generic matrix z. Define B n similarly, 
except take the union over all (p, q) in the n x n grid. Both sets generate l n , as 
shown in |Ful| (see also HMSl Chapter 15] for an exposition). 

Theorem 6.1. Ifn G S n is a permutation that is not vexillary, then neither A n nor B n is 
a Grobner basis of l n under any diagonal term order. 
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In what follows, we say that a pipe dream P poisons a diagonal or a minor if 
at least one member of the diagonal (or the diagonal term of the minor) coincides 
with a — |— in P. We will also say that P is a poisoning of a set of diagonals or 
minors if it poisons each element in the set. The poisoning of a set is minimal if by 
removing any cross from P, some element in the set is no longer poisoned. Recall 
the diagram D(7t) from Section I3TTT and let C(7t) denote the n x n pipe dream 
formed by placing — |— tiles in the boxes of D [n). 

Our proof of Theorem l6.1l is based on the following. 

Proposition 6.2. The cross diagram C[n) is a poisoning of A n . Moreover, C{n) is a 
minimal poisoning of A n if and only if it is vexillary. 

The proof of this proposition requires a number of intermediate results. As in 
Section |3j identify each permutation n with its dot-matrix. 

Lemma 6.3. For any diagonal 5 not poisoned by C[n), the following holds. 

a) Each element of b is either south of a dot of n in the same column, or east of a dot 
of n in the same row. 

b) No dot of 7i has an element of 5 south of it in the same column and a different element 
of b east of it in the same row. 

Proof. These statements are immediate consequences of the definitions. □ 

We identify diagonals with the products of the corresponding variables in the 
array z. Recall that z pxq denotes the northwest pxq submatrix of z. 

Corollary 6.4. The following hold for any (p,q) e D(7t). 

a) Any diagonal in z pX q that is not poisoned by C{n) has size at most r^q. 

b) If (p , q) is any maximally northwest box in D (n) with the property that at least two 
of the r^q = rp_i )q _i dots in 7r (p _ 1 ) X (q_ 1 ) do not lie on a diagonal, then any diagonal 
in Z( p _i) X (q_-|) not poisoned by C{n) has size at most Tp q — 1 . 

Proof. Part (a) follows immediately from the definition of r n and Lemma 1631 

Our hypotheses in part (b) imply that some pair of dots in 7T(p_i) x (q— i)/ say at 
(i, j) and (k, i), forms an antidiagonal (where, say (i, j) occurs to the southwest of 
(k, I)). Additionally, in Z( p _i)x(q-i)/ every column from I through q — 1 has a dot 
of 7r: if not, some box of D(7t) in row p strictly west of (p, q) would contradict our 
assumptions on (p, q). Similarly, every row from i through p — 1 has a dot of n. 

Assume that some diagonal 6 in Z( p _ 1 ) x( q_ 1 ) not poisoned by C(7t) has maximal 
length r^q. Suppose that for some h satisfying I < h < q — 1, no element of b lies 
in column h weakly south of the dot of n there, and choose h maximal with this 
property. It follows that if • is the dot of n in column h, then any element of 5 in 
the hook of • lies in the hook of some other dot of n (by maximality of h), and 5 
is forced to have size less than Tp q by Lemma l6~3l Therefore, every column from I 
through q — 1 has an element of 5 weakly south of the dot of 7t there. Similarly, 
every row from i through p — 1 has an element of 5 weakly east of the dot of 7t there. 

Where is the element of b in column 12 If it is weakly north of row i, then any 
element of 5 east of (i, j ) in row i also lies south of some other dot of n (in a column 
from I to q — 1 ). On the other hand, if the element of 5 in column i is weakly south 
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of row i, then it lies east of some other dot of n (in a row from i to p — 1 ). In both 
cases, 6 is forced to have size less than r£ q by Lemma l6~3l a contradiction. □ 

Proof of Proposition ^. 2\ Part (a) of Corollary l6.4l proves the first assertion. For the re- 
maining assertion, suppose first that n is vexillary. Pick any (p, q) G £ss{n). Corol- 
lary |33] shows that the diagonal formed by the dots of 7r (p _ 1 ) X (q_ 1 ) together with 
(p, q) form a diagonal of size 1 + Tp q . Hence we cannot remove (p, q) from C(7t) 
and remain a poisoning. Thus C(7t) is a minimal poisoning. 

Conversely, suppose that n is not vexillary. By Corollary 13.31 we find can find 
(p, q) G D(7t) that is maximally northwest with the property that at least two 
dots of 7t( r _i) x ( s _i) are in antidiagonal position. We claim that removing the cross 
of C{n) from (p, q) results in a smaller poisoning. If this is not true, we can find 
(i, j) G £ss(7t) to the southeast of (p, q) and a diagonal of size 1 + Ttj in zt x j unpoi- 
soned by C(7t) \ (p, q) but containing (p, q). By Corollary I6.4f b) the part of this 
diagonal in z pxq (including (p, q) itself) has size at most Tp q . The rest of this diago- 
nal, which lies strictly south and strictly east of (p, q), has size at most — r pq by 
Lemma 16.31 because this rank difference equals the number of dots of 7tt X j in the 
union of all rows > p and columns > q. Hence the maximal size of our unpoisoned 
diagonal is \\ a contradiction. This completes the proof of Proposition 16 .21 □ 

For the proof of Theorem 16.11 we will also need the following. 

Proposition 6.5. For any permutation n, the diagonal term of each minor in B^ is divisible 
by the diagonal term of some minor in A n . 

Proof. Fix a minor in B^ of size 1 + in Z| X j. If (i, j) G D(7t) then the result follows 
by definition, so assume otherwise. 

As the minor's diagonal 5 is larger than the number of dots in 7r iX j, Lemma l6~3l 
implies that some element in 5 must lie in D (n) . Let (p , q ) be the coordinates of the 
most southeast such occurrence. If at least 1 + Tp q elements of 6 are northwest of 
(p, q), we are done. On the other hand, if this does not occur, at least ry — Tp q + 1 
elements of 6 are strictly to the southeast of (p, q). By our choice of (p, q), this part 
of the diagonal misses D (71) . Hence we obtain a contradiction in view of Lemma l6~3l 
(use the same argument as the one ending the proof of Proposition 16.21 ) . □ 

Proof of Theorem IOI Assume that n is not vexillary. As the ideals ir^A^) and in(B 7t ) 
generated by the diagonal terms of all minors in A^ and B^ coincide by Proposi- 
tion !6.51 it suffices to prove that in(A 7t ) 7^ in(I 7t ). The zero set of in(I 7t ) has the same 
dimension as the zero set of l n , so it is enough to show that the dimension of the 
zero set of in(A 7t ) exceeds that of 1^. Equivalently, it suffices to prove that in(A 7I ) 
has a component whose codimension is strictly less than the length of n. 

The variables corresponding to the — |— tiles in any pipe dream P that poisons A n 
generate an ideal Jp that contains in(A 7t ) by definition. The codimension of Jp 
equals the number of — |— tiles in P. The theorem now follows from Proposition 16.21 
because the number of — |— tiles in C(7t) is the length of n. □ 
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